Translation Verification Statement 



I, Satoshi AMAGI, 

of c/o PREZIO IP Firm, Gotanda TG Bldg. 9F, 9-2, Nishi-Gotanda 7-chome, 
Shinagawa-ku, Tokyo 141-0031 Japan, hereby declare that I am conversant with the 
Japanese and the English languages and that I am the translator of the documents 
attached and certify that to the best of my knowledge and belief the following is a true 
and correct translation of the certified copy of Japanese Patent Application No. 
2003-282122 filed on July 29, 2003, in the name of NEC Corporation. 




Signed by 



Satoshi AMAGI 



(printed name) 




JP2003-282122 



JAPAN PATENT OFFICE 



This is to certify that the annexed is a true copy of the 
following application as filed with this Office. 



Date of Application: July 29, 2003 

Application Number: Patent Application No, 2003-282122 

The country code and number JP2 0 0 3-2 82 12 2 
of your priority application, 
to be used for filing abroad 
under the Paris Convention, is 



Applicant (s ) 



NEC CORPORATION 



JP2003-282122 



[Document Name] Application for Patent 
[Reference No.] 34103785 
[Filing Date] July 29, 2003 

[To addressee] Commissioner of the Patent Office 

[International Patent classification] C12Q 1/68 
[ Inventor] 

[Address] c/o NEC Corporation, 

7-1, Shiba 5-chome, Minato-ku, Tokyo 

[Name] Tomoharu KIYUNA 

[Inventor] 

[Address] c/o NEC Corporation, 

7-1, Shiba 5-chome, Minato-ku, Tokyo 

[Name] Ken j i OKAJIMA 

[Inventor] 

[Address] c/o NEC Corporation, 

7-1, Shiba 5-chorne, Minato-ku, Tokyo 

[Name] Hiroaki TORII 

[ Inventor] 

[Address] c/o NEC Corporation, 

7-1, Shiba 5-chome, Minato-ku, Tokyo 

[Name] Ken' ichi KAMIJO 

[Applicant for Patent] 

[Id. No*] 000004237 

[Name] NEC Corporation 

[Agent] 

[Id. No.] 100110928 

[Patent Attorney] 

[Name] Shinji HA YAM I 

[Phone No.] 03-5784-4637 

[Application Fees] 

[Prepayment Registration No,] 138392 
[Amount of Payment] 21000 yen 

[List of Documents Attached] 

[Name of Document] Claims 1 

[Name of Document] Specification 1 

[Name of Document] Drawings 1 



JP2003-282122 



[Name of Document] Abstract 1 

[General Power of Attorney No.] 0110433 



JP2003-282122 



Applicant's History Information 

Identification Number [000004237] 

1. Date of Change August 29, 1990 

[Reasons of Change] New Registration 

Address 7-1, Shiba 5-chome, Minato-ku, Tokyo 
Name NEC CORPORATION 



Ref.:34103785 Appln. No. JP2003-282122 



Filing Date: July 29, 2003 



[Claims ] 
[Claim 1] 

A method of evaluating a cell state based on information 
5 of an image taken of a cell containing a chromosome territory, 
the method comprising: 

extracting said chromosome territory from said image; 

standardizing a positioning state of said chromosome 
territory and then quantifying said positioning state; and 

10 evaluating said cell state based on the quantified 

positioning state of said chromosome territory* 
[Claim 2] 

The evaluation method as set forth in Claim 1, 

wherein in said chromosome territory extraction, in 
15 addition to extracting a nucleus of said cell, said chromosome 
territory contained in said nucleus is extracted, and 

said positioning state quantification comprises 
standardizing a form of said nucleus and transforming 
coordinates of said chromosome territory based on a change in 
20 form between said nucleus before standardization and said 
nucleus after standardization. 
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[Claim 3] 
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The evaluation method as set forth in Claim 1 or Claim 2, 
the method further comprising: 

statistically processing a quantification result of said 
5 positioning state of a plurality of cells, 

wherein in said cell state evaluation, a state of a single 
cell is evaluated based on a result of quantifying said 
positioning state of said single cell and a result of said 
statistical processing . 

10 [Claim 4] 

The evaluation method as set forth in Claim 3, 

wherein said statistical processing comprises calculating 
a standard value of a quantification result of said positioning 
state based on a result of quantifying said positioning state 
15 of a plurality of cells, and 

in said cell state evaluation, a state of a single cell 
is evaluated based on a result of quantifying said positioning 
state of said single cell and said standard value. 

[Claim 5] 

20 A method of evaluating a cell state based on information 

of an image taken of a cell containing a chromosome territory, 
the method comprising: 
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extracting a plurality of chromosome territories from said 

image; 

quantifying a positioning state of said plurality of 
chromosome territories; 

5 statistically processing results of quantifying said 

positioning state of a plurality of cells; and 

evaluating a state of a single cell based on a result of 
quantifying said positioning state of said single cell and a 
result of said statistical processing. 

10 [Claim 6] 

The evaluation method as set forth in Claim 5, 

wherein said positioning state comprises at least one of 
a distance between said plurality of chromosome territories and 
a positioning direction of said plurality of chromosome 
15 territories. 

[Claim 7] 

The evaluation method as set forth in Claim 5 or 6, 

wherein said quantifying comprises calculating a distance 
between said plurality of chromosome territories, 

20 [Claim 8] 

The evaluation method as set forth in Claim 7, 
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wherein said distance calculation comprises: 



calculating a center of gravity of each of said plurality 
of chromosome territories; and 

calculating a distance between said centers of gravity. 
[Claim 9] 

The evaluation method as set forth in any one of Claims 
5 to 8, 

wherein said quantifying comprises quantifying the 
positioning direction of said plurality of chromosome 
territories . 

[Claim 10] 

The evaluation method as set forth in Claim 9, 

wherein said positioning direction quantification 
comprises : 

detecting a principal axis of each of said plurality of 
chromosome territories; and 

calculating an angle of said principal axis. 

[Claim 11] 
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A method of evaluating a cell state based on information 

of an image taken of a cell containing a chromosome territory, 

the method comprising: 

extracting from said image each of a nucleus of said cell 
5 and the chromosome territory; 

quantifying a positioning state of said nucleus and said 
chromosome territory; 

statistically processing results of quantifying said 
positioning state of a plurality of cells; and 

10 evaluating a state of a single cell based on a result of 

quantifying said positioning state of said single cell and a 
result of said statistical processing. 

[Claim 12] 

The evaluation method as set forth in Claim 11, 

15 wherein said quantifying comprises calculating a distance 

between a reference point within said nucleus and said chromosome 
territory. 

[Claim 13] 

The evaluation method as set forth in any one of Claims 
20 5 to 12, 

wherein said positioning state quantification of said 
chromosome territory further comprises standardizing a 
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positioning state of said chromosome territory, and after 

standardizing the positioning state of said chromosome territory, 

quantifying said positioning state. 

[Claim 14] 

5 The evaluation method as set forth in Claim 13, 

wherein said statistical processing comprises calculating 
a standard value of a quantification result of said positioning 
state based on a result of quantifying said positioning state 
of a plurality of cells; and 

10 in said cell state evaluation, a state of a single cell 

is evaluated based on a result of quantifying said positioning 
state of said single cell and said standard value. 

[Claim 15] 

The evaluation method as set forth in any one of Claims 
15 1 to 14, 

wherein said positioning state comprises at least one of 
a relative position of said chromosome territory within a nucleus 
of said cell, a direction of a principal axis of said chromosome 
territory, and a spread of said chromosome territory. 

20 [Claim 16] 

The evaluation method as set forth in any one of Claims 
1 to 15, 
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wherein said image is formed from a plurality of pixels 

each having an attribute value; 

said chromosome territory extraction comprises: 

classifying said image into a plurality of classes; and 

extracting any of said classes from said image as a region 
representing said chromosome territory, and 

said classifying comprises: 

setting an initial value for an attribute parameter 
indicating an attribute value of each of said classes and for 
a mixture ratio of each of said classes; 

calculating based on said attribute parameter and said 
mixture ratio a class membership probability of each of said 
plurality of pixels being classified into each of said classes; 

calculating an evaluation function which represents a 
goodness of estimation based on said membership probability and 
a mixture probability distribution defined by said attribute 
parameter and said mixture ratio and determining whether or not 
said evaluation function satisfies predetermined conditions; 

updating said attribute parameter and said mixture ratio 
when said evaluation function does not satisfy said 
predetermined conditions; and 
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classifying said plurality of pixels into any of said 

plurality of classes based on said attribute parameter and said 

mixture ratio when said evaluation function satisfies said 

predetermined conditions . 

5 [Claim 17] 

The evaluation method as set forth in Claim 16, 

wherein said class membership probability calculation 
comprises : 

decomposing said plurality of pixels into a plurality of 
10 partial spaces according to the attribute value of said pixels; 

calculating a coarse-grained empirical probability 
distribution representing a proportion of pixels contained in 
said partial space; and 

calculating based on said attribute parameter and said 
15 mixture ratio a coarse-grained class membership probability of 
each of said partial spaces being classified into each of said 
classes; and 

said evaluation function calculation comprises 
calculating a coarse-grained mixture probability distribution 
20 by averaging, within said partial space, mixture probability 
distributions defined by said attribute parameter and said 
mixture ratio, said evaluation function being calculated based 
on said coarse-grained empirical probability distribution, said 
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coarse-grained mixture probability distribution, and said 

coarse-grained class membership probability, 
[Claim 18] 

A system for evaluating a cell state based on information 
of an image taken of a cell containing a chromosome territory, 
the system comprising: 

an extraction processing unit which extracts said 
chromosome territory from said image; 

a quantification processing unit which quantifies a 
positioning state of said chromosome territory that has been 
extracted; 

a memory unit which stores a result of quantifying said 
positioning state; 

a statistical processing unit which statistically 
processes a result of quantifying said positioning state of a 
plurality of cells; and 

an evaluating unit which evaluates a state of a single cell 
based on a result of quantifying said positioning state of said 
single cell and a result of said statistical processing. 

[Claim 19] 

The evaluation system as set forth in Claim 18, 
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wherein said quantification processing unit standardizes 

the positioning state of said chromosome territory extracted 

from said image and, after standardizing the positioning state 

of said chromosome territory, quantifies said positioning state. 

5 [Claim 20] 

The evaluation system as set forth in Claim 19, 

wherein said extraction processing unit extracts a nucleus 
of said cell and also extracts said chromosome territory 
contained in said nucleus, and 

10 said quantification processing unit standardizes a form 

of said nucleus and transforms coordinates of said chromosome 
territory based on a change in form between said nucleus before 
standardization and said nucleus after standardization. 

15 [Claim 21] 

A program which, in a computer, evaluates a cell state 
based on information of an image taken of a cell containing a 
chromosome territory, the program making the computer function 
as : 

20 a unit which extracts said chromosome territory from said 

image; 
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a unit which standardizes a positioning state of said 

chromosome territory and then quantifies said positioning state; 
and 

a unit which evaluates said cell state based on the 
quantified positioning state of said chromosome territory. 

[Claim 22] 

A program which, in a computer, evaluates a cell state 
based on information of an image taken of a ceil containing a 
chromosome territory, the program making the computer function 
as : 

an extracting unit which extracts said chromosome 
territory from said image; 

a quantifying unit which quantifies a positioning state 
of said chromosome territory that has been extracted; 

a memory unit which stores a result of quantifying said 
positioning state; 

a statistical processing unit which statistically 
processes a result of quantifying said positioning state of a 
plurality of cells; and 

an evaluating unit which evaluates a state of a single cell 
based on a result of quantifying said positioning state of said 
single ceil and a result of said statistical processing. 
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[Document Name] Specification 

[Title of the Invention] METHOD OF EVALUATING CHROMOSOME 
STATE AND EVALUATION SYSTEM 
[Technical Field of the Invention] 
5 [0001] 

The present invention relates to a method and a system for 
evaluating a state of a cell and of a chromosome contained in 
a cell based on a positioning state of a chromosome territory 
in an interphase of a cell cycle. 

10 [Background Art] 

[0002] 

Conventionally, chromosome morphology can only be observed 
in a condensed state of a mitotic phase of a cell cycle* However, 
owing to recent developments in visualization techniques 

15 (3D-FISH, confocal laser microscopy) , it has become possible to 
observe the positioning and morphology of chromosomes in an 
interphase of a cell cycle- In accordance with such 
visualization techniques it has become clear that, within the 
nucleus of a cell in an interphase, individual chromosomes are 

20 present separately in regions that are not intermingled with each 
other (Non-patent Publication 1, Non-patent Publication 
2) . Hereinafter, the region occupied by an individual 
chromosome within the nucleus is called a chromosome territory. 

[Non-patent Publication 1] 
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T. Crerner, C. Cremer, CHROMOSOME TERRITORIES NUCLEAR 

ARCHITECTURE AND VENE REGULATION IN MAMMALIAN CELLS, NATURE 

REVIEWS/GENETICS, vol. 2, pp. 292-301, 2001 

[Non-patent Publication 2] 

Hideyuki Tanabe, 'Chromosome territory: recent 
advancement of studies on interphase chromosome intranuclear 
positioning in relation to nuclear architecture \ Environ. 
Mutagen Res., 25, pp. 11 to 22, 2003 

[Patent Publication 1] 

Japanese Laid-open Patent Publication No. 2001-92980 

[Disclosure of the Invention] 
[Problem of the Invention] 

[0003] 

It is thought that a change from a normal cell to a tumor 
cell and a change from a benign tumor cell to a malignant tumor 
cell are caused by gene mutation or gene translocation. In 
Non-patent Publication 2, the concept of the probability of 
spatially adjacent chromosome territories undergoing 
translocation being higher than that of those positioned far from 
each other is described, 

[0004] 
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From the above, it can be expected that changes in a cell 

could be evaluated by examining the spatial positioning of 

chromosome territories. However, there has conventionally been 

no technique provided for quantitatively analyzing the spatial 

positioning of chromosome territories and evaluating changes in 

a cell . 

[0005] 

The inventors of the present application have devised the 
invention below for the purpose of evaluating a cell state by 
examining the positioning state of a chromosome territory in an 
interphase of a cell cycle, and using, based on the evaluation 
result, the ceil state as an index for diagnosis of a disease 
such as cancer. 

[Means for solving the Problem] 
[0006] 

According to the present invention, there is provided a 
method of evaluating a cell state based on information of an image 
taken of a cell containing a chromosome territory, the method 
including extracting the chromosome territory from the image, 
standardizing a positioning state of the chromosome territory 
and then quantifying the positioning state, and evaluating a ceil 
state based on the quantified positioning state of the chromosome 
territory. 

[0007] 
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Here, the positioning state may include at least one of 

the relative position of the chromosome territory in the cell 

nucleus, the direction of the principal axis of the chromosome 

territory, and the spread of the chromosome 

5 territory. Furthermore, the standardization referred to is 

processing in order to quantify the forms of chromosome regions 

in a plurality of cells using a unified index. By carrying out 

such processing, quantification can be carried out for a 

plurality of cells using a unified index. 

10 [0008] 

The cell state evaluation referred to here means evaluating 
the state of a chromosome contained in the cell, and evaluating 
changes occurring in the cell, the expectancy of an abnormality 
in the morphology of the cell, chromosome translocation, and the 

15 possibility of being affected by a disease such as cancer based 
on changes occurring in the cell. In accordance with the 
evaluation method of the present invention, since the form of 
a chromosome territory can be quantified, it can be expected that, 
based on the quantification result, an abnormality in the 

20 morphology of the cell or the existence of a disease will be 
detected at an early stage. 

[0009] 

The image taken of a cell may contain a plurality of images 
obtained by imaging the cell nucleus at nuclear cross sections, 
25 and the chromosome territory extraction may include extracting 
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a chromosome territory image in three dimensions by extracting 

a chromosome territory from each of the plurality of images and 

combining these images. 

[0010] 

5 In the evaluation method of the present invention, in the 

chromosome territory extraction, in addition to extracting a 
cell nucleus a chromosome territory contained in the nucleus may 
be extracted, and the positioning state quantification may 
include standardizing the form of a nucleus and transforming the 

10 coordinates of a chromosome territory based on a change in form 
between the nucleus before standardization and the nucleus after 
standardization- The change in form of the nucleus referred to 
here may include a change in the shape and a change in the 
size. The chromosome territory coordinate transformation may 

15 be carried out by coordinate transformation based on a relative 
relationship between the nucleus before standardization and the 
chromosome territory and a relative relationship between the 
nucleus after standardization and the chromosome territory. 

[0011] 

20 The evaluation method of the present invention may further 

include statistically processing the quantification results of 
a positioning state of a plurality of cells, and in the cell state 
evaluation, a state of a single cell may be evaluated based on 
a result of quantifying a positioning state of the single cell 

25 and a result of statistical processing. 
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[0012] 



In the evaluation method of the present invention, the 
statistical processing may include calculating a standard value 
of the quantification result of the positioning state based on 
5 the result of quantifying a positioning state of a plurality of 
cells, and in evaluating a cell state, a state of a single cell 
may be evaluated based on a result of quantifying a positioning 
state of the single cell and the standard value. 

[0013] 

10 In the evaluation method of the present invention, the 

standard value calculation may include calculating an average 
value of the result of quantifying the positioning of chromosomes 
of a plurality of cells. 

[0014] 

15 According to the present invention, there is provided a 

method of evaluating a cell state based on information of an image 
taken of a cell containing a chromosome territory, the method 
including extracting a plurality of chromosome territories from 
the image, quantifying a positioning state of the plurality of 

20 chromosome territories, statistically processing the result of 
quantifying the positioning state of a plurality of cells, and 
evaluating a state of a single cell based on a result of 
quantifying a positioning state of the single cell and a result 
of statistical processing. 
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[0015] 



In this way, by comparing the result of quantifying the 
positioning state of a chromosome territory of a single cell with 
the result of statistical processing, the degree of abnormality 
5 of the single cell can be evaluated. Furthermore, in accordance 
with the evaluation method of the present invention, since the 
form of a chromosome territory can be quantified, it can be 
expected that, based on the quantification result, an 
abnormality in the morphology of the cell or the existence of 
10 a disease will be detected at an early stage. 

[0016] 

In the evaluation method of the present invention, the 
positioning state may include at least one of a distance between 
the plurality of chromosome territories and a positioning 
15 direction of the plurality of chromosome territories, 

[0017] 

In the evaluation method of the present invention, the 
quantification may include calculating a distance between the 
plurality of chromosome territories. 

20 [0018] 

In the evaluation method of the present invention, the 
distance calculation may include calculating a center of gravity 
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of each of the plurality of chromosome territories and 

calculating a distance between the centers of gravity. 
[0019] 

Furthermore, in the evaluation method of the present 
5 invention, the distance calculation may be carried out as 
follows . 

[0020] 

In the evaluation method of the present invention, the 
distance calculation may include calculating a distance between 
10 chromosome territories using the Mahalanobis distance. 

[0021] 

In the evaluation method of the present invention, the 
distance calculation may include calculating a distance between 
boundaries of chromosome territories. Here, as the distance 
15 between boundaries of chromosome territories, the shortest 
distance between the boundaries may be used. 

[0022] 

In the evaluation method of the present invention, the 
distance calculation may include approximating the forms of the 
20 plurality of chromosome territories using a normal distribution, 
calculating an average value of the normal distribution of each 
of the chromosome territories, and calculating a distance 
between the average values. 
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[0023] 



In the evaluation method of the present invention,, the 
distance calculation may include detecting a skeleton line of 
each of the plurality of chromosome territories, calculating a 
center of gravity of the skeleton line, and calculating a 
distance between the centers of gravity. 

[0024] 

In the evaluation method of the present invention, the 
quantification may include quantifying the positioning 
direction of the plurality of chromosome territories. 

[0025] 

In the evaluation method of the present invention, the 
quantification of the positioning direction may include 
detecting a principal axis of each of the plurality of chromosome 
territories and calculating an angle of the principal axis. 

[0026] 

In the evaluation method of the present invention, the 
detection of a principal axis may include approximating the forms 
of the plurality of chromosome territories using a normal 
distribution, calculating an average value of the normal 
variance and a covariance matrix of each of the chromosome 
territories based on the approximated forms of the chromosome 
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territories, and subjecting the covariance matrix to eigenvalue 

decomposition . 
[0027] 

According to the present invention, there is provided a 
5 method of evaluating a cell state based on information of an image 
taken of a cell containing a chromosome territory, the method 
including extracting each of a cell nucleus and a chromosome 
territory from the image, quantifying a positioning state of the 
nucleus and the chromosome territory, statistically processing 
10 the result of quantifying the positioning state of a plurality 
of cells, and evaluating a state of a single cell based on a result 
of quantifying a positioning state of the single cell and a result 
of statistical processing. 

[0028] 

15 In the evaluation method of the present invention, the 

quantification may include calculating a distance between a 
reference point within the nucleus and the chromosome 
territory. The reference point within the nucleus referred to 
here may be, for example, a nuclear wall or a center of gravity. 

20 [0029] 

In the evaluation method of the present invention, the 
quantification of a positioning state of the chromosome 
territory may further include standardizing a positioning state 
of the chromosome territory, and the positioning state 
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quantification may be carried out after standardizing a 

positioning state of the chromosome territory, 
[0030] 

In the evaluation method of the present invention, the 
5 statistical processing may include calculating a standard value 
of a quantification result of a positioning state based on a 
result of quantifying a positioning state of the plurality of 
cells, and in the cell state evaluation, a state of a single cell 
may be evaluated based on a result of quantifying the positioning 
10 state of the single cell and the standard value. 

[0031] 

In the evaluation method of the present invention, the 
calculation of a standard value may include calculating an 
average value of results of quantifying a positioning state of 
15 a plurality of cells. 

[0032] 

According to the present invention, there is provided a 
method of evaluating a cell state based on information of an image 
taken of a cell containing a chromosome territory, the method 
20 including extracting each of a cell nucleus and a plurality of 
chromosome territories from the image, standardizing the form 
of the nucleus, transforming the coordinates of the chromosome 
territories based on a fixed criterion determined according to 
a change in form between the nucleus before standardization and 
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the nucleus after standardization, calculating a center of 

gravity of each of the transformed chromosome territories, 

calculating a distance between the centers of gravity of the 

plurality of chromosome territories, statistically processing 

5 the obtained distance between the centers of gravity with respect 

to a plurality of cells, and evaluating a state of a single cell 

based on the distance between the centers of gravity of the single 

cell and a result of statistical processing. 

[0033] 

10 In the evaluation method of the present invention, the 

evaluation of a cell state may include quantifying, using the 
t-test, a difference between a result of quantifying a 
positioning state of the single cell and a result of statistical 
processing „ 

15 [0034] 

In the evaluation method of the present invention, the 
evaluation of a cell state includes quantifying, using the 
chi-square test, a difference between a result of quantifying 
a positioning state of the single cell and a result of statistical 
20 processing. 

[0035] 

According to the present invention, there is provided a 
system for evaluating a cell state based on information of an 
image taken of a cell containing a chromosome territory, the 
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system including an extraction processing unit which extracts 

a chromosome territory from the image, a quantification 

processing unit which quantifies a positioning state of the 

extracted chromosome territory, a memory unit which stores a 

result of quantifying the positioning state, a statistical 

processing unit which statistically processes results of 

quantifying a positioning state of a plurality of cells, and an 

evaluating unit which evaluates a state of a single cell based 

on a result of quantifying a positioning state of the single cell 

and a result of statistical processing. 

[0036] 

In the evaluation system of the present invention, the 
quantification processing unit may standardize the positioning 
state of the chromosome territory extracted from the image, and 
quantify said positioning state after standardizing the 
positioning state of the chromosome territory. 

[0037] 

In the evaluation system of the present invention, the 
extraction processing unit may extract a cell nucleus as well 
as extract a chromosome territory contained in said nucleus, and 
the quantification processing unit may standardize the form of 
the nucleus and transform the coordinates of the chromosome 
territory based on a change in form between the nucleus before 
standardization and the nucleus after standardization. 

[0038] 

24 



Ref.:34103785 Appln. No. .IP2003-282122 Filing Date: July 29, 2003 

According to the present invention, there is provided a 

program which, in a computer, evaluates a cell state based on 

information of an image taken of a cell containing a chromosome 

territory, the program making the computer function as a unit 

5 which extracts a chromosome territory from the image, a unit 

which standardizes a positioning state of the chromosome 

territory and then quantifies the positioning state, and a unit 

which evaluates a ceil state based on the quantified positioning 

state of the chromosome territory. 

10 [0039] 

According to the present invention, there is provided a 
program which, in a computer, evaluates a cell state based on 
information of an image taken of a cell containing a chromosome 
territory, the program making the computer function as an 

15 extracting unit which extracts a chromosome territory from the 
image, a quantifying unit which quantifies a positioning state 
of the extracted chromosome territory, a memory unit which stores 
a result of quantifying the positioning state, a statistical 
processing unit which statistically processes a result of 

20 quantifying a positioning state of a plurality of cells, and an 
evaluating unit which evaluates a state of a single cell based 
on a result of quantifying a positioning state of the single cell 
and a result of statistical processing. 

[0040] 
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In the evaluation method of the present invention, the 

image may be formed from a plurality of pixels each having an 

attribute value, and the chromosome territory extraction may 

include classifying an image into a plurality of classes, and 

5 extracting any of the classes from the image as a region 

representing a chromosome territory* The classifying here 

includes setting an initial value for an attribute parameter 

indicating an attribute value of each class and for a mixture 

ratio of the classes, calculating based on the attribute 

10 parameter and the mixture ratio a class membership probability 
of each of the plurality of pixels being classified into each 
of the classes, calculating an evaluation function which 
represents a goodness of estimation based on the membership 
probability and a mixture probability distribution defined by 

15 the attribute parameter and the mixture ratio and determining 
whether or not the evaluation function satisfies predetermined 
conditions, updating the attribute parameter and the mixture 
ratio when the evaluation function does not satisfy the 
predetermined conditions, and classifying the plurality of 

20 pixels into any of the plurality of classes based on the attribute 
parameter and the mixture ratio when the evaluation function 
satisfies the predetermined conditions. 

[0041] 

By use of this method, a chromosome territory can be 
25 extracted from an image with high accuracy, By extracting a 
chromosome territory with high accuracy, variation in the 
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quantification result for the chromosome territory can be 

reduced,, and evaluation of a cell state can be improved. 
[0042] 

In the evaluation method of the present invention, the 
5 class membership probability calculation may include 

decomposing the plurality of pixels into a plurality of partial 
spaces according to the attribute value of the pixels, 
calculating a coarse-grained empirical probability distribution 
representing the proportion of pixels contained in a partial 

10 space, and calculating based on the attribute parameter and the 
mixture ratio a coarse-grained class membership probability of 
each of the partial spaces being classified into each of the 
classes; the evaluation function calculation may include 
calculating a coarse-grained mixture probability distribution 

15 by averaging, within a partial space, mixture probability 

distributions defined by the attribute parameter and the mixture 
ratio; and an evaluation function may be calculated based on the 
coarse-grained empirical probability distribution, the 
coarse-grained mixture probability distribution, and the 

20 coarse-grained class membership probability. 

[0043] 

By carrying out such coarse-graining, the processing time 
can be greatly shortened. The coarse-graining is explained in 
detail below. 

25 [0044] 
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As the method of extracting a chromosome territory of the 

present invention, the following methods are also effective. 

(1) An extraction method involving, with respect to an image 
containing an extraction target image, classifying pixels in the 
5 image into a plurality of classes and extracting a desired region, 
the method including: 

a first step of decomposing a data space formed from all 
the attribute values that each pixel of the image can take into 
partial spaces at a given resolution, and forming a 
10 coarse-grained data space that holds sets of pixels taking 

attribute values in each of said partial spaces, the average of 
attribute values of said pixels, and the number of said pixels, 

a second step of calculating a coarse-grained empirical 
probability distribution in the coarse-grained data space by 
15 dividing the number of pixels of each partial space by the total 
number of pixels contained in the image, 

a third step of initializing a class mixture ratio and a 
class parameter that defines the attribute of each class, 

a fourth step of calculating a conditional probability 
20 distribution under a class designated by the class parameter, 
and calculating a coarse-grained conditional probability 
distribution by averaging the conditional probability 
distributions within each partial space, 
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a fifth step of calculating a class membership probability, 

which is a probability of each pixel belonging to each class, 

by multiplying the class mixture ratio by the coarse-grained 

conditional probability distribution, 

5 a sixth step of updating the class parameter and the class 

mixture ratio, 

a seventh step of calculating an evaluation function using 
the coarse-grained conditional probability distribution, 

an eighth step of examining whether or not the evaluation 
10 function satisfies given completion conditions, and 

a ninth step of determining a class to which each pixel 
belongs based on the class parameter, the class mixture ratio, 
and the class membership probability when the evaluation 
function satisfies the given completion conditions, and 
15 extracting a desired region. 

[0045] 

Here, as the evaluation function, a coarse-grained log 
likelihood may be used. In this process, in the sixth step, the 
class parameter and the class mixture ratio may be updated so 
20 as to increase the evaluation function. Furthermore, in the 
third step, a number of classes may be initialized. A number 
of classes may also be set at a given value beforehand. Moreover, 
in the extraction method of the present invention, the fourth, 
fifth, sixth, seventh, and eighth steps may be repeated until 
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the evaluation function satisfies the given conditions in the 

eighth step. 
[0046] 

(2) The extraction method as set forth in (1) above, 

5 wherein when calculating a coarse-grained conditional 

probability distribution in the fourth step, an average value 
of attribute values of pixels contained in each partial space 
is calculated, and a coarse-grained conditional probability 
distribution in each partial space is calculated using the 
10 average value. 

[0047] 

(3) The extraction method as set forth in (1) or (2) above, 
wherein the method further includes 

a tenth step of examining whether the coarse-graining 
15 resolution is the original resolution, and 

an eleventh step of restoring the resolution of a partial 
space to the original resolution, 

after the resolution of the partial space is restored to 
the original resolution, the first step to the eighth step being 
20 carried out, and 

in the third step the class parameter and the class mixture 
ratio in the ninth step being used as initial values. 
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[0048] 



{4) The extraction method as set forth in any one of (1) to 

(3) above, 

wherein in the ninth step a number of pixels belonging to 
5 each class is calculated by multiplying a corresponding class 
mixture ratio when the evaluation function satisfies the given 
completion conditions by the total number of pixels contained 
in the image, and a pixel belonging to each class is determined 
by selecting pixels at the above-mentioned number of pixels in 
10 order from the highest class membership probability. 

[0049] 

(5) The extraction method as set forth in any one of (1) to 

(4) above, 

wherein in the seventh step the AIC is used as the 
15 evaluation function, and in the sixth step the parameter is 
changed so as to decrease the evaluation function. 

[0050] 

(6) The extraction method as set forth in any one of (1) to 
(4) above, 

20 wherein in the seventh step the MDL (Minimum Description 

Length) is used as the evaluation function, and in the sixth step 
the parameter is changed so as to decrease the evaluation 
function. 
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(7) The extraction method as set forth in any one of (1) to 
(4) above, 

wherein in the seventh step the Structural Risk is used 
5 as the evaluation function, and in the sixth step the parameter 
is changed so as to decrease the evaluation function. 

[0052] 

(8) The extraction method as set forth in any one of (1) to 
{7) above, 

10 wherein the third step includes 

setting a neighbor radius which defines whether or not 
partial spaces are in the neighborhood of each other, and setting 
a number of classes (step Bl) , 

setting a representative value of each partial space for 
15 each of the partial spaces (step B2) , 

setting a set of classification target partial spaces (step 

B3) , 

selecting, among the set of classification target partial 
spaces, a partial space having the highest coarse-grained 
20 empirical probability (step B4 ) , 

selecting, as a neighbor set, all partial spaces having 
a representative value whose distance from the representative 
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value of the partial space having the highest coarse-grained 

empirical probability is within the neighbor radius {step B5) , 

examining whether or not the shortest distance between the 
representative value of the partial spaces contained in an 
already classified class and the representative value of the 
partial spaces contained in the neighbor set is larger than the 
neighbor radius {step B6} , 

if in step B6 the shortest distance between the 
representative value of the partial spaces contained in the 
already classified class and the representative value of the 
partial spaces contained in the neighbor set is larger than the 
neighbor radius, making the neighbor set a new class and deleting 
the neighbor set from the classification target partial spaces 
(step B7) , 

if in step B6 the shortest distance between the 
representative value of the partial spaces contained in the 
already classified class and the representative value of the 
partial spaces contained in the neighbor set is smaller than the 
neighbor radius, adding the neighbor set to the already 
classified class and deleting the neighbor set from the 
classification target partial spaces (step B8), 

examining whether or not the classification target partial 
spaces are an empty set (step B9) , 

if in step B9 the classification target partial spaces are 
not an empty set, repeating step B4 and thereafter, 
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if in step B9 the classification target partial spaces are 

an empty set,, examining whether or not the number of classified 

classes is equal to or greater than a given number (step BIO), 

if in step BIO the number of classified classes is less 
5 than the given number, reducing the neighbor radius (step Bll) , 
and repeating step B3 and thereafter, and 

if in step BIO the classification target partial spaces 
are an empty set and the number of already classified classes 
is greater than the given number, calculating a class parameter 
10 within each class, making this an initial value of the class 
parameter, and making the ratio of the number of partial spaces 
contained in each class an initial value of the class mixture 
ratio (step B12) . 

[0053] 

15 In steps B7 and B8, if the shortest distance between the 

representative value of the partial spaces contained in the 
already classified class and the representative value of the 
partial spaces contained in the neighbor set is equal to the 
neighbor radius, either processing may be carried out. 

20 [0054] 

(9) An extraction device which, with respect to an image 
containing an extraction target image, classifies pixels in the 
image into a plurality of classes and extracts a desired region, 
the device including, 



34 



Ref.:34103785 Appln, No, .IP2003-282122 Filing Date: July 29, 2003 

an inputting device which reads in an image, 

a region coarse-graining device which decomposes a data 
space formed from all the attribute values that each pixel of 
the image can take into partial spaces at a given resolution, 
5 holds sets of pixels taking attribute values in each of said 
partial spaces, the average of the attribute values of said 
pixels, and the number of said pixels, and forms a coarse-grained 
data space, 

a coarse-grained empirical probability distribution 
10 calculating device which calculates a coarse-grained empirical 
probability distribution in a coarse-grained data space by 
dividing the number of pixels of each partial space by the total 
number of pixels contained in the image, 

a coarse-grained conditional probability distribution 
15 device which calculates a coarse-grained conditional 

probability distribution by initializing a class parameter 
defining the attribute of each class and a class mixture ratio, 
calculating from the class parameter defining the attribute of 
each class a conditional probability distribution under a 
20 designated class, and averaging conditional probability 

distributions under designated classes for each partial space, 

a class membership probability calculating device which 
calculates from the coarse-grained conditional probability 
distribution a class membership probability of each pixel of the 
25 image belonging to each class, 
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a parameter updating device which updates the class 

parameter and the class mixture ratio, 

an evaluation function calculating device which calculates 
an evaluation function using a coarse-grained conditional 
probability distribution, 

a region extraction device which extracts a desired region 
by examining whether or not the evaluation function satisfies 
given completion conditions, and determining a class to which 
each pixel belongs based on the class parameter, the class 
mixture ratio, and the class membership probability when the 
evaluation function satisfies the given completion conditions, 
and 

an outputting device which outputs an extracted region. 

[0055] 

Here, the evaluation function calculating device may 
employ as the evaluation function the coarse-grained log 
likelihood, the AIC, the MDL, or the Structural Risk. When the 
evaluation function calculating device employs as the evaluation 
function the coarse-grained log likelihood, the parameter 
updating device may update the class parameter and the class 
mixture ratio so as to increase the evaluation 
function. Furthermore, when the evaluation function 
calculating device employs as the evaluation function the AIC, 
the MDL, or the Structural Risk, the parameter updating device 
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may update the class parameter and the class mixture ratio so 
as to decrease the evaluation function. 



[00563 

(10) The extraction device as set forth in (9) above, wherein 
5 the device further includes 

a resolution restoring device which examines whether the 
coarse graining resolution is the original resolution after it 
has been confirmed that the evaluation function satisfies the 
given completion conditions, and restores the resolution of the 
10 data space to the original resolution. 

[0057] 

The operation of the extraction method and the extraction 
device as set forth in (1) to (10) above are explained below. 

In the extraction method as set forth in (1} above, the 
15 attribute value of each pixel forming an image is considered as 
a random variable, and a desired region is extracted based on 
the probability distribution of an estimated pixel value. Here, 
as the attribute value, for example, a luminance value may be 
used for a monochrome image, and an intensity, et cetera, of red 
20 (R) , green (G) , and blue (B) color elements may be used for a 
color image. 

[0058] 



37 



Ref.:34103785 Appln. No. JP2003-282122 Filing Date: July 29, 2003 

Here, in order to extract a desired region, the pixels are 

classified into a plurality of groups having similar attributes, 

based on the attribute value of each pixel. In the present 

specification, a set of pixels having similar attributes is 

5 called a class . Each class is characterized by an average value, 

variance, et cetera, of attribute values belonging to the 

class. Hereinafter, these characteristics of the class are 

called T class parameters 1 of the class and are expressed as cp ± 

(i = 1,,, 3c). Here, k is a number of classes. Here, the 

10 probability of a j th pixel taking an attribute value of Xj can 

be expressed by the following mixture distribution. 

[0059] 

[Eq. 1] 

ft 

«=1 



15 [0060] 

Here, f (Xj|cpi) is a conditional probability distribution 
assuming that data is generated from the i th class, w± is a mixture 
ratio of each class, and 

[0061] 

20 [Eq. 2] 
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I k 0>i =1 
i=l 

is satisfied* 
[0062] 

In the case in which the image is a monochrome image, Xj 
5 is expressed as an integer value of 0 to 255, et 

cetera. Furthermore, in the case in which the image is a color 
image, Xj is expressed as a three-dimensional vector (Xji, x j2 , 
Xj 3 ) whose components are values of RGB color elements. Here, 
each Xji (1 = 1, 2, 3) takes an integer value of, for example, 
10 0 to 255. 

[0063] 

The mixture ratio wi represents an area ratio (in the case 
of a two-dimensional region) or a volume ratio (in the case of 
a three-dimensional region) of regions belonging to different 

15 classes. It is assumed that, for example, there is a monochrome 
image formed from two regions, that is, a bright image region 
(called Class 1) characterized by having an average luminance 
of 200 and a luminance standard deviation of 20, and a dark region 
(called Class 2) characterized by having an average luminance 

20 of 50 and a luminance standard deviation of 10. It is also 

assumed that the bright region occupies 70% of the image area 
and the dark region occupies 30% thereof. In this case, the 
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number of classes is k = 2, the class parameters are cpi = (200, 

20) and cp 2 = {50, 10) , and the mixture distribution of this image 

can be expressed as follows. 

[0064] 

5 [Eq. 3] 

p (xj)=(X 7 ( Xj | 200, 20) +0. 3 (x j [ 50, 10) »™ ( 2 ) 

[0065] 

Hereinafter, the class mixture ratio w ± and the class 
parameter <p ± are together expressed by 0 ± . Hereinafter, when 
10 simply using 'parameter', it means 9± . 

[0066] 

In the extraction method as set forth in (1) above, a 
parameter that maximizes an average log likelihood defined as 
below is estimated, 

15 [0067] 

[Eq. 4] 

^sS^-sE^S^w (3) 

J j-i L<=i J 

and region extraction is carried out using the estimated 
parameter information. Here, n denotes a number of pixels 
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contained in the image. Such a statistical method is called the 

maximum likelihood method. However, it is in general difficult 

to estimate a parameter that maximizes the average log 

likelihood. Therefore, instead of the average log likelihood, 

5 an expectation value Q of a complete log likelihood represented 

by the following amount may be used for estimation, of the 

parameter . 

[0068] 

[Eq.5] 



1 J^^. * 
Q ^^^ZY1^7 log [WiftXj 
j=1 t=l 



(4) 



10 



Here, 



[0069] 



[Eq. 6] 



15 is a probability of the j th pixel belonging to the i th class. In 
the present invention, this is called the class membership 
probability. It has been mathematically proven that if the 
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parameter is updated so as to increase Q, the above-mentioned 

average log likelihood L is also certain to increase (for example, 

A. P. Dempster, N . M. Laird, and D. B. Rubin, Maximum Likelihood 

From Incomplete Data via The EM Algorithm, J. Roy. Stat. Soc, 

5 vol. 30, pp. 205-248, 1977 (hereinafter, called Non-patent 

Publication 3) ) . 

[0070] 

A procedure which estimates a parameter and actually 
extracts a region using the estimated parameter in the present 
10 invention is now explained. 

First, a class membership probability represented by 
Equation (5) is determined by starting with appropriate initial 
parameters. Subsequently, the parameters w and <p are updated 
so as to increase Q, and Q is calculated anew. This procedure 

15 is repeated until Q finally stops increasing. A region is 
extracted using the parameters w and cp when Q finally stops 
increasing. Among k classes, for example, in order to extract 
a pixel belonging to the i th class, a value of the membership 
probability of each pixel belonging to the i th class is first 

20 examined. Subsequently, pixels having a probability value of 
equal to or greater than a certain value are classified as 
belonging to that class. When all the pixels are classified into 
corresponding classes, a class having a desired attribute is 
selected from the k classes, and by extracting the pixels 

25 belonging to that class from the image a desired region can 
automatically be extracted. 
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[0071] 



In the present invention, in order to carry out the 
maximization of Q at high speed, the coarse-grained probability 
distribution is introduced* The coarse-grained probability 
5 distribution is formed by decomposing a space containing all the 
values that the data can take {hereinafter, called a data space) 
into N partial spaces that do not intersect each other, and 
assigning a probability to each partial space. 

[0072] 

10 Specifically, a coarse-grained conditional probability 

distribution in the j th partial space is defined by 

[0073] 
[Eq. 7] 




and the coarse-grained conditional probability distribution is 
defined as below. 

[0074] 

[Eq. 8] 
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/ (* I fc) = 5^ £ fayiAj {x) (7) 

Here, Aj denotes the j th partial space. When D is the entire data 
space, 

[0075] 

5 [Eq. 9] 

V = U^, Aif)Ai = $ (i^j) ---.-(8) 

are satisfied. Furthermore, X A (x) is an indicator function that 
is 1 when the data value is contained in the partial space A and 
otherwise is 0, and 

10 [0076] 

[Eq, 10] 

m (A) = J A dx 

is a measure of A (the area of A when the data space is 
two-dimensional and the volume when it is three-dimensional) . 
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[0077] 



By use of the coarse-grained conditional probability 
distribution thus defined, Q shown in Equation (4) above can be 
rewritten as follows. 

[0078] 

[Eq. 11] 



ft 

Q - £ lo B \y*fj (&)] ( 9 

Here, 
[0079] 
[Eq. 12] 



1 ^ 

&5S ^E J A*W (10) 



is a coarse-grained empirical probability distribution, and 

[0080] 

[Eq. 13] 
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3 — v^fc ~ ~ 



(11) 



is a coarse-grained class membership probability. By maximizing 
the coarse-grained complete log likelihood given by Equation (9) , 
the coarse-grained average log likelihood below can be 
maximized. 

[0081] 
[Eq- 14] 



AT 



(12) 



[0082] 



10 Compared with the original Q, the Q given by Equation (4) 

is the sum with respect to the entire data, but the coarse-grained 
complete log likelihood given by Equation (9) is the sum only 
with respect to the partial spaces. As hereinafter described, 
by carrying out such coarse-graining, the amount of calculation 

15 can be greatly reduced. For example, in the case of a 512 * 512 
pixel image, if Equation (4) is used, it is necessary to take 
a sum of more than 260,000 data, but if the coarse-grained 
distribution of the present invention is used, it can be reduced 
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down to a sum of about 1,000 with respect to the partial spaces, 

and a high speed estimation can be carried out. 
[0083] 

Furthermore, in the extraction method as set forth in (2) 
5 above, the coarse-grained probability value of each partial 
space is approximated by a probability value at an average value 
of the data contained in the partial space. 

[0084] 

[Eq. 15] 



/iWi) = /(x,M (13) 



10 

Here, 

[0085] 
[Eq. 16] 



15 is an average value of the data contained in the j th partial space 
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Aj . By this approximation, integration (or summation) within 

a partial space can be omitted, and the amount of calculation 

can be further reduced. 

[0086] 

5 Furthermore, it is also possible to carry out estimation 

again at the original resolution using, as an initial value, a 
parameter estimated using the coarse-grained probability 
distribution. In this case, since substantially the most 
appropriate parameter has been obtained by use of the 
10 coarse-grained probability distribution, compared with a case 
in which estimation is carried out from the beginning at the 
original resolution, the number of times of sequential updating 
of the parameter can be greatly reduced, and a highly accurate 
estimation can therefore be carried out at high speed. 

15 [0087] 

Furthermore, when a region is extracted, it is also 
possible to carry out estimation of the number of pixels 
belonging to the i th region by multiplying the estimated mixture 
ratio Wi by the total number of pixels. The top n ± pixels having 

20 the highest region membership probability are extracted as the 
pixels belonging to this region. By this method, a threshold 
value, which is the value of the probability value up to which 
it is considered to belong to the region, can automatically be 
determined. In the present invention, in order to quantify the 

25 form of the chromosome territory and evaluate a cell state based 
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on the quantification result, it is necessary to extract a 

chromosome territory from an image with good accuracy. By 

automatically determining a threshold value as described above, 

a chromosome territory can be extracted with good accuracy. 

5 [0088] 

Moreover, as the evaluation function, it is also possible 
to use each of the AIC, the MDL, and the Structural Risk and select 
a model that gives the smallest value. When the AIC, the MDL, 
or the Structural Risk is used as the evaluation function, if 
10 an excessive number of parameters are used, since the value of 
the evaluation function increases, it is possible to estimate 
an optimum number of parameters. This enables an appropriate 
number of regions, that is, how many types of regions an image 
is formed from, to be estimated. 

15 [0089] 

As hereinbefore described, when a chromosome territory is 
extracted from an image, if coarse-graining is carried out, 
compared with a case in which no coarse-graining is carried out, 
since the amount of calculation of the conditional probability 

20 distribution or the class membership probability can be greatly 
reduced, the time taken for extracting a chromosome territory 
can be greatly shortened. Although the class parameter 
estimated as a result of such processing has poorer accuracy 
compared with a case in which no coarse-graining is carried out, 

25 since extraction of a region is carried out based on the class 
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membership probability calculated from the class parameter in 

the extraction method of the present invention, it is possible 

to extract a region with good accuracy without being influenced 

by errors from coarse-graining. 

[0090] 

Constitutions of the present invention are explained above, 
and any combination of these constitutions is also effective as 
an embodiment of the present invention. Furthermore, conversion 
of expression of the present invention into another category is 
also effective as an embodiment of the present invention. 

[Effect of the Invention] 

[0091] 

In accordance with the evaluation method of the present 
invention, a positioning state of a chromosome territory in an 
interphase of a cell cycle can be quantified. This enables a 
cell state to be evaluated statistically. 

[Best Mode For Carrying Out The Invention] 

[0092] 

FIG. 1 is a flowchart showing a processing procedure of 
the method of evaluating a cell state in an embodiment of the 
present invention . 
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First, from an image taken of a ceil containing a chromosome 

territory, a chromosome territory image is extracted (S20) . In 

the present embodiment, images of the cell nucleus and a 

plurality of chromosome territories are each extracted from a 

three-dimensional image. Subsequently, a positioning state of 

the chromosome territory is quantified (S22) . The result of 

quantifying the positioning state of the chromosome territory 

is stored. For a plurality of samples, processing of step 20 

and processing of step 22 are carried out, and quantification 

results for the plurality of samples are accumulated 

{S24) . Furthermore, a particular sample is subjected to 

processing of step 20 and processing of step 22, the 

quantification result is compared with the quantification 

results of the plurality of samples accumulated in step 24, and 

a cell state of the particular sample is thus evaluated (S26) . 

[0093] 

FIG. 2 is a block diagram showing an evaluation device of 
the present embodiment carrying out the processing procedure 
shown in FIG. 1. 

An evaluation device 100 includes an image acquiring unit 
102, an extraction processing unit 104, a quantification 
processing unit 106, an evaluating unit 110, an outputting unit 
112, and a quantification result memory unit 114. The image 
acquiring unit 102 acquires a three-dimensional image taken of 
a cell containing a chromosome territory. The extraction 
processing unit 104 extracts a chromosome territory image from 
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the three-dimensional image. The quantification processing 

unit 106 quantifies a positioning state of the chromosome 

territory- The quantification processing unit 106 stores the 

quantification result in the quantification result memory unit 

114. The evaluating unit 110 compares the quantification result 

of a particular sample with the quantification results of a 

plurality of samples stored in the quantification result memory 

unit 114, and evaluates a cell state of the particular 

sample- The outputting unit 112 outputs the result of extraction 

of a chromosome region image by the extraction processing unit 

104, or the result of evaluation of a cell state by the evaluating 

unit 110. The outputting unit 112 may be formed from, for example, 

a display device or a printer. 

[0094] 

Each procedure shown in FIG. 1 is explained below. 

(Extraction of chromosome territory (S20) ) 

A three-dimensional image of a cell containing a chromosome 
territory may be obtained using the 3D-FISH (Fluorescent in situ 
hybridization) method- The image acquiring unit 102 may be 
formed from an image scanner, a digital camera, et cetera, and 
an image obtained using the 3D-FISH method may be read 
in. Furthermore, the image acquiring unit 102 may be formed from 
a computer connected to a biological microscope, and it is 
possible to directly input an image via a network. 

[0095] 
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The procedure of the 3D-FISH method is explained below. 

Cells are cultured on a cover glass, and PFA 
(Paraformaldehyde) is used for fixing cells. Subsequently, a 
treatment with a TritonXlOO solution is carried out. Freezing 
and thawing is then repeated several times using liquid 
nitrogen- Following this, a hydrochloric acid treatment and a 
pepsin treatment are carried out. This allows cell membrane and 
nuclear membrane to be partially destroyed, thus enhancing the 
penetrability for a probe. Furthermore, the above-mentioned 
treatments enable parts other than the nucleus to be removed to 
some extent. 

[0096] 

Subsequently, cells are fixed again, and DNA is denatured 
at about 75 °C. As a result, double strand DNA is converted into 
single strands. Labeled probes (DNA fragments that are 
complementary to a target chromosome territory and the nucleus) 
are added thereto, and by carrying out a reaction at about 37 °C, 
the probes are complementarily bonded to the target chromosome 
territory and the nucleus. The probes are provided with dyes 
that generate colors at different wavelengths according to the 
type of target chromosome territory and the nucleus. By 
irradiating with a wavelength at which a particular dye generates 
a color, it is possible to make only that dye generate a color 
distinctively. 

[0097] 
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By irradiating a sample prepared as above with a particular 

wavelength using a confocal laser microscope, an image 

containing a target chromosome territory is obtained. By 

superimposing images containing chromosome territories and an 

5 image containing the nucleus, an image containing a plurality 

of chromosome territories may be obtained. 

Processing to which the image thus obtained is subjected 
is explained below. Hereinafter, when simply 'chromosome 
territory' and 'nucleus 1 are referred to, they do not mean the 
10 chromosome territory or the nucleus themselves, but mean a 
chromosome territory image and a nucleus image on an image. 

[0098] 

The extraction processing unit 104 shown in FIG. 2 carries 
out image processing involving extracting a chromosome territory 

15 from an image obtained as above. In the present embodiment, the 
extraction processing unit 104 extracts images of the chromosome 
territory and the nucleus from the image by classifying an image 
containing a plurality of pixels into a plurality of classes, 
and assigning each of the plurality of classes to the chromosome 

20 territory and the nucleus. In this process, the extraction 
processing unit 104 assumes that there are a plurality of 
luminance sources having different luminances in each pixel, and 
carries out a classification based on the probability of each 
luminance source belonging to that pixel and the mixture ratio 

25 of the luminance sources in the image. 
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[0099] 



Such a technique is described in, for example, Japanese 
Laid-open Patent Publication No. 2001-92980 (hereinafter called 
Patent Publication 1) , Patent Publication 1 describes a 
technique in which, from image data, an expectation value of a 
region membership probability of each pixel on an image belonging 
to each of the regions is calculated, an evaluation function is 
calculated based on a mixture probability distribution 
determined from the region membership probability and a region 
parameter, each of the regions is separated based on the region 
membership probability in the above process, and a contour is 
extracted based on the separated regions. In the present 
embodiment, the concept of coarse-graining is further introduced 
to this technique, and an optimum parameter is obtained at high 
speed* 

[0100] 

FIG. 3 is a block diagram showing the extraction processing 
unit 104 shown in FIG. 2. FIG. 4 is a flowchart showing a 
processing procedure of the extraction processing unit 104* 

[0101] 

The extraction processing unit 104 in an embodiment of the 
present invention includes an inputting device 1 which reads in 
image data, a data space coarse-graining device 2, a parameter 
updating device 6, a coarse-grained empirical probability 
distribution calculating device 3, a coarse-grained conditional 
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probability distribution calculating device 4, a class 

membership probability calculating device 5, an evaluation 

function calculating device 7, a region extraction device 8, and 

an outputting device 9, 

5 [0102] 

The inputting device 1 inputs, from the image acquiring 
unit 102, a color image of a cell obtained by the 3D-F1SH method 
as described above (step Al ) . The inputting device 1 sends the 
data thus read in to the data space coarse-graining device 2. 

10 [0103] 

The data space coarse-graining device 2 decomposes the data 
space into N partial spaces that do not intersect each other so 
as to form a coarse-grained data space (step A2) . The data space 
referred to here means a set of all the attribute values that 

15 the pixels of an image can take. For example, in a standard gray 
scale image, the attribute of each pixel may be expressed as a 
luminance, and the luminance is usually a one-dimensional space 
expressed by an integer of 0 to 255. Furthermore, in the case 
of a standard color image, it is usually a three-dimensional 

20 space expressed by an integer of 0 to 255 for each color element 
of R, G, and B. 

[0104] 

The data space coarse-graining device 2 sections each of 
the RGB values into, for example, eights if the resolution is 



56 



Ref.:34103785 Appln. No. JP2003-282122 Filing Date: July 29, 2QQ3 

8, and a 8 * 8 * 8 cube may be defined as one partial space* The 

resolution need not be identical in the axes of three 

dimensions. For example, coarse-graining may be carried out by 

sectioning the R axis into hi, the G axis into h 2 , and the B axis 

into h 3 as long as the partial spaces do not overlap each other 

and the entire data space is covered without fail. Hereinafter, 

when expressed as coarse-graining with a resolution of h, it 

means that the RGB values are sectioned into h x h * h. 

[0105] 

Furthermore, the data space coarse-graining device 2 
contains sets of pixels (the numbers of the pixels) that take 
values in each partial space, the average attribute values of 
these pixels, and the number of pixels. 

[0106] 

FIG. 5 shows a coarse-grained data space 11 and a partial 
space 12 when coarse-graining is carried out at a resolution of 
hi x h 2 * h 3 . 

For example, when an attribute value Xj of a j th pixel is 
such that R = 128, G = 255, and B = 18, if coarse-graining is 
carried out at a resolution of 8, this pixel takes a value in 
a partial space designated by an index (16, 31, 2) . This is 
expressed below by Xj being contained in this partial space. 

[0107] 
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Referring back to FIG. 3, after forming a coarse-grained 

data space, the data space coarse-graining device 2 sends the 

numbers of the pixels contained in each partial space and the 

number of pixels to the coarse-grained empirical probability 

5 distribution calculating device 3. 

[0108] 

The coarse-grained empirical probability distribution 
calculating device 3 calculates a coarse-grained empirical 
probability distribution (step A3) . The coarse-grained 

10 empirical probability distribution referred to here indicates 
a probability distribution calculated from a value obtained by 
dividing observation data contained in each partial space of the 
coarse-grained data space by the total number of pixels. The 
coarse-grained empirical probability distribution calculating 

15 device 3 sends the coarse-grained empirical probability 

distribution to the coarse-grained conditional probability 
distribution calculating device 4. 

[0109] 

The coarse-grained conditional probability distribution 
20 calculating device 4 initializes a class parameter (step 

A4) . The procedure of determining an initial value for the 
parameter is described later. The coarse-grained conditional 
probability distribution calculating device 4 also calculates 
a coarse-grained conditional probability distribution (step 
25 AS). Specifically, the coarse-grained conditional probability 
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distribution is calculated as follows. Here, it is assumed that 

a conditional probability under the condition that the j th pixel 

value is generated from an i th class is given by the 

multidimensional normal distribution shown below. 

5 [0110] 

[Eq. 17] 



20 



(15) 



Here, x denotes a three-dimensional vector formed from each color 
of RGB, \i± denotes a three-dimensional vector showing an average 
10 color of the i th class, E ± denotes a covariance matrix of the i th 
class, and | S± | and Si" 1 denote the determinant and the inverse 
matrix respectively of the matrix Si- Furthermore, (x-]a ± ) T 
denotes transposition . 

In the case in which the image is a gray scale, a conditional 
15 probability under the condition that the j th pixel value is 

generated from the i th class is given by a one-dimensional normal 
distribution shown below. 

[Eq. 18] 
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Here, x denotes a scalar value expressing a luminance value, \i± 

denotes a scalar value expressing an average luminance of the 

i th class, and a± denotes a standard deviation of the luminance 

of the i th class. 

5 [0111] 

The coarse-grained conditional probability distribution 
calculating device 4 calculates this conditional probability 
using an equation given by Equation (6) . In this process, a 
measure m (Aj) of each partial space is the volume of each partial 
10 space. For example, when coarse-graining is carried out 
uniformly at a resolution of 8, it is 8 * 8 * 8 = 512. 

[0112] 

The coarse-grained conditional probability distribution 
calculating device 4 may approximate the coarse-grained 
15 conditional probability distribution using Equation (13) . In 
accordance with this method, it becomes unnecessary to carry out 
the operation given by Equation (6) each time the parameter is 
updated, thereby greatly reducing the amount of calculation* 

[0113] 

20 The coarse-grained conditional probability distribution 

calculating device 4 is capable of determining an initial value 
for the parameter based on the coarse-grained empirical 
probability distribution. It roughly classifies each partial 
space, determines an average value or a variance value within 
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each class obtained as a result of the classification, and 

determines these values as initial values for parameter 
estimation. 

[0114] 

FIG. 6 is a flowchart showing a processing procedure of 
determining an initial value for a parameter based on the 
coarse-grained empirical distribution. The procedure of 
setting an initial value for the parameter is explained below 
with reference to FIG. 6. 

[0115] 

Firstly, in step Bl, a neighbor radius and a number of 
classes that are to be classified are set. The neighbor radius 
referred to here is a reference value for carrying out a rough 
classification by considering all of the partial spaces within 
the range to belong to the same class. For example, in the case 
of a color image, pixels having similar colors have RGB values 
that are close to each other, and they can therefore be naturally 
considered to be classified into the same class. 

[0116] 

When the neighbor radius is too large, classification might 
be completed before a desired number of classes is attained. In 
such a case, as described later, the neighbor radius is reduced, 
and classification is carried out again. It is thereby possible 
to finally carry out classification into a necessary number of 
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classes. An initial value for this neighbor radius is therefore 

set at a sufficiently large value, for example, 50. As the number 

of classes to be classified into, a given value is used as it 

is . 

[0117] 

Subsequently, in step B2, a representative value for each 
partial space is set for each partial space. As the 
representative value for each partial space, for example, a 
median value, et cetera, of the partial space can be 
used. Hereinafter, a distance between these representative 
values is defined as a distance between partial spaces. 

[0118] 

Subsequently, a set of partial spaces, which become a 
classification target, is set (step B3) . Hereinafter, this set 
is expressed as Q . An initial value for Q is a set formed from 
all the partial spaces containing data. Furthermore, the number 
i of already classified classes is 1, and an initial value for 
an already classified class Ci is an empty set. 

[0119] 

Subsequently, among the partial spaces belonging to Q, a 
partial space that has the highest coarse-grained empirical 
probability is selected (step B4) - This partial space is 
expressed as A s . Subsequently, a distance between a partial 
space belonging to Q and A s is examined, all the partial spaces 
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that are within a neighbor radius r are selected, and this is 

determined to be a neighbor set (step B5) . Hereinafter, the 

neighbor set is expressed as B s . 

[0120] 

5 Subsequently, the shortest distance between a partial 

space contained in the already classified class C± and a partial 
space contained in the neighbor set B s is determined, and it is 
examined whether or not this is larger than the neighbor radius 
r (step B6) . If this shortest distance is larger than r, since 

10 the neighbor set B s has an attribute that is sufficiently 

different from that of the already classified class and appears 
with high probability, it may be considered to be a new 
class • Therefore, the neighbor set is employed as a new class 
as it is. Since classification of B s has been completed, it is 

15 deleted from the classification target set Q. In FIG . 6, this 
deletion is expressed using the code T Q <- Q \ Bs 1 . After Q is 
updated, the flowchart returns to step B4 (step B7) . 

[0121] 

If the shortest distance between a partial space contained 
20 in the already classified class Ci and a partial space contained 
in the neighbor set B s is smaller than the neighbor radius r, 
since the neighbor set B s and the C± can be considered to have 
close attributes, B s is integrated with Cj.. Since classification 
of B s has been completed, it is deleted from the classification 
25 target set Q (step B8) . 
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[0122] 



Subsequently, whether or not Q is an empty set is examined 
{step B9) ; if it is not an empty set, the flowchart goes to step 
B4, if Q is an empty set, whether or not the number of classified 
classes is equal to or greater than k is examined (step BIO) , 
and if it is equal to or less than k, the neighbor radius is 
reduced by multiplying the neighbor radius by a constant that 
is smaller than 1. With regard to this constant, for example, 
a value of 0.9, et cetera, may be used. Following this, step 
B3 and thereafter are repeated. 

[0123] 

In step B9, if O is an empty set and the number of already 
classified classes is larger than a given number, then since 
classification into a desired number of classes is completed, 
a class parameter of each class is calculated, this is defined 
as an initial value for the class parameter, and the ratio of 
the number of partial spaces contained in each class is defined 
as an initial value for the class mixture ratio (step B12) . 

[0124] 

FIG. 7 is a diagram specifically explaining the procedure 
explained with reference to FIG. 6. It is assumed here that the 
data space is one-dimensional, and a total of 10 partial spaces 
are set (FIG. 7(a)), In FIG. 7(a), the abscissa denotes the 
numbers of the partial spaces, and the ordinate denotes a 
coarse-grained empirical probability 

64 



Ref.:34103785 Appln, No. JP2003-282122 Piling Date: July 29, 2003 

distribution. Hereinafter, the principal object is to explain 

the flow of processing intuitively, and specific values are 

therefore not used for the coarse-grained empirical probability 

value, the representative value of the partial space, and the 

5 neighbor radius, 

[0125] 

In step Bl, the number of classes is for example 2, and 
the neighbor radius is r. In step B2, a representative value 
for each partial space is set. In step B3, initial values for 
10 the classification target set Q are all the partial spaces 
containing data, as follows. 

a = {A 3 , A 4 , A 5 , A 6 , A 7 , A 8 } 

Since Ai, A 2 , A 9 , and Aio have a coarse-grained probability of 0, 
that is, no data are observed to be contained in these partial 
15 spaces, they are not included in the classification target set. 

[0126] 

In step B4, among the partial spaces included in the 
classification target set, A7 , which has the highest 
coarse-grained empirical probability, is selected and defined 
20 as As (FIG. 7 (a) ) . In step B5, a partial space that is present 
within the neighbor radius r from A 7 is selected and defined as 
Bs. Since the partial spaces that are present within the 
neighbor radius shown in FIG. 7 (a) are A 5 , A 6 , A 7 , and A 8 , then 
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Bs = {A 5 , A 6 , R 7 , A 8 } 
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(FIG. 7 (b) ) - 
[0127] 

In step B6, since there are not yet classified classes, 
5 B s is employed as an initial class Ci as it is, Bi is deleted from 
the classification target set, and the flowchart returns to step 
B4. In FIG. 7(b) , blank white bars of the bar graph showing the 
extent of the coarse-grained empirical probability mean that the 
partial spaces have been deleted from the classification target 
10 set. 

[0128] 

In step B4, since A 4 has the highest coarse-grained 
empirical probability among the remainder of the classification 
target set, this is defined anew as A s (FIG. 7(c)), In step B5, 
15 a partial space that is present within the neighbor radius r from 
A 4 is selected and defined as B s . Here, it is expressed as 
follows . 

B s = {A 3 , A 4 } 

[0129] 

20 In step B6, by examining the already classified classes, 

that is, 

Ci = {A 5 , A 6 , A 7 , A 8 } 
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they are found to include A 5 and A 6/ which are within the neighbor 

radius r from A4. Therefore, the current B s is integrated with 

the already classified class Ci (FIG. 7 (d) ) . 

[0130] 

The classification target set thereby becomes empty, and 
classification of all the partial spaces is completed, but the 
number of classified classes is 1 and has not attained a desired 
number of classes of 2 (step BIO) . Therefore, the neighbor 
radius is reduced (step Bll), and step B3 and thereafter are 
repeated. 

[0131] 

Hereinafter, the reduced radius is expressed as r' (FIG. 
7 (e) ) , and the same procedure as in the above-mentioned 
explanation is repeated. However, since the neighbor radius is 
reduced this time, the following difference occurs. That is, 
this time a partial space that is present within the neighbor 
radius r 1 of A 7 is as follows. 

B s = {A Sr A 7 , A Q ] 

This B s is employed as a first class Ci as it is, and A 4 , 
which has the highest coarse-grained empirical probability among 
the remainder of the classification target set, is selected (FIG. 
7 (g) ) . Partial spaces that are present within the neighbor 
radius r T from A 4 are as follows. 
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B s = {A 3/ A 4 , A 5 } 

Since this time the already classified class Ci contains no 
partial space that is within the neighbor radius r T from A 4/ the 
current B s is employed as a new class C 2 ( FIG. 7 (h) ) > This 
5 results in completion of classification of all the partial spaces 
into two classes as desired. 

[0132] 

When rough classification is completed, an average and a 
variance are determined within the classified class, and they 

10 may be used as initial parameters for estimation carried out 
thereafter. By setting an initial value for a parameter by such 
a method, the amount of calculation following this may be reduced 
and region extraction may be carried out at high 
speed. Furthermore, appropriately setting an initial parameter 

15 is effective in preventing falling into a local optimum solution 
during maximization of the coarse-grained log likelihood, 

[0133] 

Referring back to FIG. 3, the coarse-grained conditional 
probability distribution calculating device 4 may determine a 

20 coarse-grained conditional probability distribution using the 
parameter determined above as an initial value. The 
coarse-grained conditional probability distribution 
calculating device 4 sends the determined coarse-grained 
conditional probability distribution to the class membership 

25 probability calculating device 5, 
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[0134] 

The class membership probability calculating device 5 
calculates a class membership probability using Equation (11) 
(step A6) . This class membership probability indicates the 
5 probability of a pixel contained in a j th partial space belonging 
to an i th class. Therefore, by calculating a class membership 
probability for each image pixel, and classifying each pixel into 
a class for which the probability is high, region extraction can 
be carried out easily. The class membership probability 
10 calculating device 5 sends the calculated class membership 
probability to the parameter updating device 6. 

[0135] 

The parameter updating device 6 updates the parameter so 
as to maximize Equation (9) . Specifically, the parameter is 
15 updated as follows. 

[0136] 

[Eq. 19] 
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Here, 

[0137] 
[Eq. 20] 



u<8> v 



T 



represents a matrix having a product UjVj of an i component and 
a j component of vectors u and v as an ij element. 

[0138] 

[Eq. 21] 



10 
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is the average value of data contained in the j th partial space 

Aj, which is defined by Equation (14) . 
[0139] 

In the case where the image is a gray scale, updating of 
5 wi and ui may be carried out in the same manner as above using 
a luminance value as x, and updating of the standard deviation 
o is as follows. 

[Eq. 22] 



10 
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As described above, by updating the parameter in this way, 
the coarse-grained complete log likelihood given by Equation (9) 
increases, and the coarse-grained average log likelihood given 
by Equation (12) also increases (Non-patent Publication 3) . The 
parameter updating device 6 updates the parameter and then sends 
15 the updated parameter to the evaluation function calculating 
device 7. The evaluation function calculating device 7 
calculates a coarse-grained log likelihood using Equation (12) 
{step A8) . 
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[0140] 



Furthermore, as the evaluation function, other than the 
coarse-grained log likelihood shown by Equation (12) , the Akaike 
Information Criterion (AIC: Akaike Information Criterion) , the 
MDL, or the Structural Risk, which will be explained below, may 
be used. 

Firstly, the AIC is explained. 

[0141] 
[Eq. 23] 



Here, it is possible to use an evaluation function for which 
the smaller the AIC, the better the estimation result. Here, 
m denotes the total number of parameters. Since the AIC is 
proportional to an amount obtained by multiplying the 
coarse-grained log likelihood by a negative, the AIC changes in 
a direction such that it decreases when updating using the 
parameter changing device 6. Furthermore, since a term that is 
proportional to the parameter is added, an estimation result 
obtained using a model having fewer parameters is considered to 
be better for identical coarse-grained log likelihoods. In 
accordance with use of this evaluation function, it is possible 
to suppress excessive fitting to data and carry out an estimation 
that is resistant to noise. 




(19) 
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[0142] 

Furthermore, the same effect may be obtained using the MDL 

below . 
[0143] 
5 [Eq. 24] 



£m:ol = -nL + y logn ----- (20) 



[0144] 

Moreover, the same effect may be obtained using the 
Structural Risk below. 

10 [0145] 

[Eq. 25] 



LSRM — / , ■ ■ ■ ■ ■ • (21 ) 

1 — cJ ai ^ lna ? n / h ' h1 )Hn ( 7? /4) 

V - n 



Here, n denotes that Equation (21) holds true with a probability 
of n, and usually takes a value of 0.01, et cetera. c, ai, and 
15 a 2 are constants that are determined by properties of the 

probability distribution, and usually take values such that c 
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= 1, ai = 1, and a 2 = 1, et cetera. h is called a VC dimension 

and is an amount proportional to the number of parameters. 



[0146] 

The evaluation function calculating device 7 examines 
5 whether or not a change in the evaluation function satisfies 
given completion conditions; if the completion conditions are 
satisfied, it sends a current parameter to the region extraction 
device 8 r and if the completion conditions are not satisfied, 
it sends the current parameter to the coarse-grained conditional 

10 probability distribution calculating device 4 (step A9) . With 
regard to the completion conditions, for example, a difference 
between the current evaluation function value and the evaluation 
function value calculated the previous time is divided by the 
current evaluation function value, and whether or not the 

15 absolute value of the value thus obtained is equal to or less 
than 0.0001 is examined. 

[0147] 

The region extraction device 8 receives a parameter from 
the evaluation function calculating device 7, and extracts a 

20 region using parameter information (step A10) . For example, in 
order to extract a region belonging to the i th class, the value 
of the class membership probability is examined for j = 1 to j 
= N, and a partial space that has a probability of not less than 
a certain value (threshold value) is defined as a partial class 

25 belonging to the i th class. Subsequently, pixels contained in 
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that partial space are examined, and these pixels are extracted 

as being in the i th region. By using, for example, 0,5 as the 

threshold value for the class membership probability, a desired 

result may be obtained. 

5 [0148] 

it is also possible for the region extraction device 8 to 
automatically set the threshold value. The following processing 
is carried out for this. In order to extract the i th region, the 
estimated class mixture ratio w ± is firstly multiplied by the 
10 total number of pixels, and an estimated number of pixels 

belonging to each class is determined. This figure is expressed 
as n i • 

[0149] 

Subsequently, the class membership probability is examined 
15 for j = 1 to j - N, pixels contained in the partial spaces are 
extracted, in order from the highest value of the partial space, 
and this is continued until the extracted pixels reach n±. When 
the number of pixels extracted the n ± th time is denoted by 1, the 
value of the coarse-grained class membership probability of 
20 Equation (11) becomes a threshold value for the probability of 
belonging to the i th region. By use of the threshold value thus 
automatically set, a chromosome territory can be, extracted from 
an image with good accuracy. Furthermore, the same effect may 
be obtained by the following. Firstly, a membership probability 
25 represented by Equation (11) is calculated for all the 
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pixels. By so doing, the membership probability for each of the 

k classes can be obtained for each pixel. Subsequently, only 

the pixel for which the membership probability for the i th class 

is the highest is extracted. The number of the pixels thus 

5 extracted should substantially coincide with the 

above-mentioned n±. By examining, among these pixels , the pixel 

having the largest luminance and the pixel having the smallest 

luminance, an upper limit value and a lower limit value for the 

luminance belonging to the i th class can automatically be 

10 obtained. Since a region of the chromosome territory should be 
displayed as a region having high luminance on an image, if the 
above-mentioned procedure is carried out for a class having the 
maximum average luminance as a subject, it is possible to 
automatically extract a chromosome territory region. After 

15 extraction of a region is completed, the region extraction device 
8 sends data of the extracted region to the outputting device 
9. 

[0150] 

The data space coarse-graining device 2, the 
20 coarse-grained empirical distribution calculating device 3, the 
coarse-grained conditional probability distribution 4, the 
class membership probability calculating device 5, the parameter 
updating device 6, the evaluation function calculating device 
7, and the region extraction device 8, which are described above, 
25 may be constructed, for example, using a computer such as a 
personal computer, a work station, or a supercomputer. The 
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outputting device 9 receives region data from the region 

extraction device 8 and outputs it to the quantification 

processing unit 106 of FIG . 2 (step All) . Moreover, output from 

the outputting device 9 may foe displayed by the outputting unit 

5 112. 

[0151] 

FIG. 8 is a block diagram showing another example of the 
extraction processing unit 104. FIG. 9 is a flowchart showing 
the processing procedure of the extraction processing unit 104 
10 shown in FIG . 8. The same constituent elements as those 

explained with reference to FIG. 3 and FIG. 4 are hereinafter 
denoted by the same reference numerals and symbols, and their 
explanation is not represented where appropriate. 

[0152] 

15 Here, a region restoring device 10 examines, after 

parameter estimation using the coarse-grained probability 
distribution is completed, whether the coarse-graining 
resolution is equal to the original resolution (step A12), and 
returns the data to the original resolution if it has been 

20 coarse-grained (step A13) . If it has not been coarse-grained, 
since this means that estimation at the original resolution is 
completed, the parameter estimated at the original resolution 
is sent to a region extraction device 8, For returning data to 
the original resolution, the coarse-graining resolution may be 

25 set at the minimum unit of the data attribute value (for example, 
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1) , and exactly the same method as the method described in the 

first embodiment may be repeated. In this case, estimation takes 

a longer time compared with the method explained with reference 

to FIG . 3 and FIG. 4, but a parameter can be estimated with higher 

5 accuracy, and as a result it becomes possible to extract a region 

with high accuracy. Furthermore, since a parameter estimated 

using the coarse-grained probability distribution has already 

been estimated in the neighborhood of an optimum parameter, the 

optimum parameter can be estimated with a smaller number of times 

10 of updating the parameter compared with a case in which 

estimation is carried out at high resolution from the beginning, 

and region extraction can be carried out at a much higher speed. 

[0153] 

(Positioning state quantification (S22)) 

15 Referring back to FIG. 2, the quantification processing 

unit 106 carries out standardization processing, prior to 
quantification of a positioning state of a chromosome territory, 
by transforming the coordinates of the chromosome territory 
extracted by the extraction processing unit 104 in accordance 

20 with certain criteria. By carrying out this processing, a 

positioning state of a chromosome territory may be quantified 
in accordance with unified criteria for a plurality of 
samples. By so doing, the results of the quantification of a 
positioning state of a chromosome territory for a plurality of 

25 samples may be statistically processed, et cetera. 
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FIG, 10 is a flowchart showing a processing procedure of 
quantifying a positioning state of a chromosome territory. FIG. 
11 is a schematic diagram showing the manner in which the 
5 coordinates of a chromosome territory are transformed. The 
coordinate transformation processing procedure is explained 
below with reference to FIG. 10 and FIG. 11. 

10155] 

The quantification processing unit 106 standardizes a cell 
10 nucleus 120 shown in FIG. 11(a) (FIG* 10, S100}. Here, first 
of all, a center of gravity Po and a volume V of the cell nucleus 
120 are calculated. Subsequently, as shown in FIG. 11(b), a 
reference sphere 124 is calculated so as to have the center of 
gravity Po as the center and the volume V. Here, the cell nucleus 
15 120 includes a chromosome territory 122. Although not 

illustrated in the figure, the cell nucleus 120 may include a 
plurality of chromosome territories. 

[0156] 

Following this, the coordinates of the chromosome 
20 territory 122 are transformed according to the form and size of 
the cell nucleus 120 and the reference sphere 124 ( FIG. 10, 
S102) . Specifically, as shown in FIG. 11(c), a straight line 
1 is envisioned that passes through the center of the reference 
sphere 124 (the same as the center of gravity P 0 ) and a certain 
25 point p within the chromosome territory 122, and a distance R 
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between the center P 0 and the surface of the cell nucleus 120 

on the straight line 1 is calculated. At the same time, a 

distance r 0 between the center P 0 and the surface of the reference 

sphere 124 on the straight line 1 is calculated. Here, as shown 

5 in FIG. 11(d), when the point p within the chromosome territory 

122 is transformed to a point within the reference sphere 120, 

the coordinates p ! within the reference sphere 120 are expressed 

as follows, 

p' = r 0 / R x (p - P 0 ) + Po 

10 By transforming in the same manner all the points within the 
chromosome territory 122, a chromosome territory 126 that has 
been coordinate-transformed within the reference sphere 124 can 
be obtained. 

[01571 

15 In the present embodiment, after the quantification 

processing unit 106 carries out the above-mentioned coordinate 
transformation of the chromosome territory, it quantifies a 
positioning state of the chromosome territory (FIG. 10, S104) . 

[0158] 

20 FIG. 12 is a diagram showing a plurality of chromosome 

territories, that is, chromosome territory 126a and chromosome 
territory 12 6b, which are coordinate-transformed within the 
reference sphere 124. Here, an example in which a distance 
between a plurality of chromosome territories is used as the 
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quantification result of the positioning state is shown. The 

quantification processing unit 106 calculates the distance 

between the chromosome territory 12 6a and the chromosome 

territory 126b thus coordinate-transformed. 

5 [0159] 

By carrying out the above-mentioned coordinate 
transformation of the chromosome territory, the quantification 
result of a positioning state of the chromosome territory in a 
plurality of various forms of samples can be processed using a 

10 unified index. Furthermore, in the same cell, the cell nucleus 
can take various forms depending on the stage. In the present 
embodiment, by carrying out such a coordinate transformation, 
it is possible to appropriately quantify a positioning state of 
a chromosome territory while eliminating the influence of such 

15 changes in the form of the cell nucleus according to the stage. 

[0160] 

Furthermore, when the distance between chromosome 
territories is used as the quantification result of a positioning 
state, the quantification processing unit 106 may use as a 

20 quantification result a value obtained by dividing the distance 
between chromosome territories by the radius of the reference 
sphere 124. This enables the quantification results of the 
positioning state of the chromosome territories in a plurality 
of samples having different nucleus sizes to be processed with 

25 a unified index. 



81 



Ref.:34103785 Appln. No. JP2003-282122 Filing Date: July 29, 2003 

[0161] 



A method of quantifying the positioning state of a 
chromosome territory is now explained. 

The positioning state of the chromosome territory may be 
5 quantified using a distance between a plurality of chromosome 
territories, the spread of the chromosome territory, the 
distribution direction, a distance between the chromosome 
territory and a reference point within a cell, et cetera. 

[0162] 

10 In the case in which quantification is carried out using 

the distance between a plurality of chromosome territories, the 
distance between the plurality of chromosome territories may be 
calculated by various methods. 

[0163] 

15 For example, the quantification processing unit 106 may 

calculate a center of gravity of each of the chromosome 
territories, and calculate a distance between the centers of 
gravity. The center of gravity referred to here is the center 
of gravity of an area when it is assumed that each pixel forming 

20 the chromosome territory has equal specific gravity. 

As the position of the center of gravity of each of the 
chromosome territories, for example, a center of gravity 
weighted by the luminance value described below may be used. 
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X G = SjljXj / Sjlj 

Here, Ij is a luminance value of a pixel at a position Xj . The 
position of the pixel having the highest luminance value may be 
used instead of the center of gravity- Hereinafter, a case of 
5 a simple center of gravity is explained, but a distance between 
chromosomes may be defined by the same method when a weighted 
center of gravity or the position of a pixel having the highest 
luminance is used. 

[0164] 

10 Furthermore, the quantification processing unit 106 may 

also calculate a distance between boundaries of a plurality of 
chromosome territories- The distance between the boundaries of 
the chromosome territories referred to here is for example the 
shortest distance between the surfaces of the plurality of 

15 chromosome territories. 

[0165] 

Moreover, the quantification processing unit 106 may 
approximate the form of each of the plurality of chromosome 
territories by a normal distribution, calculate an average value 

20 of the normal distribution of each of these chromosome 

territories, and calculate a distance between the average 
values. Furthermore, after the form of each of the plurality 
of chromosome territories is approximated by the normal 
distribution, the center of gravity of each of the chromosome 

25 territories may be calculated as described above to thus 
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calculate the distance between the centers of gravity, or the 

distance between the boundaries may be calculated. 
[0166] 

Furthermore, the quantification processing unit 106 may 
detect a framework line of each of the plurality of chromosome 
territories, calculate the center of gravity of each skeleton 
line, and calculate a distance between the centers of gravity. 

[0167] 

Moreover, the quantification processing unit 106 may 
calculate a distance between a plurality of chromosome 
territories by calculating the Mahalanobis distance, the 
Bhattacharyya distance, the Kullback-Leibler distance, the 
symmetrical Kullback-Leibler distance, or the absolute 
distance . 

[0168] 

The Mahalanobis distance may be calculated in accordance 
with the equation below. 

[0169] 

[Eq. 26] 
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Here, \x± (i = 1, 2} denotes an average vector, S denotes 

a covariance matrix within a class defined by 

[0170] 

[Eq. 27] 



and wi and w 2 denote class mixture ratios. 
[0171] 

The Bhattacharyya distance may be calculated in accordance 
with the equation below. 



10 [0172] 



[Eq. 28] 



+ £ 2 
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[0173] 



The Kullback-Leibler distance may be calculated in 
15 accordance with the equation below. 



85 



Ref.:34103785 Appln. No. .IP2003-282122 Filing Date: .July 29, 2003 

[0174] 



[Eq. 29] 



D 



J Pi( x ) 



In 



Pi (g) 



dx 



Here, p ± (i = 1, 2) denotes an average vector p ± , a 
5 multidimensional normal distribution of the covariance matrix 

[0175] 

The symmetrical Kullback-Leibler distance may be 
calculated in accordance with the equation below. 

10 [0176] 

[Eq. 30] 



£> = !/pi(*)ln 



das -f- 



dx 



[0177] 

The absolute distance may be calculated in accordance with 
15 the equation below. 



[0178] 
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[Eq. 31] 




pi (a?) -p 2 (x)\dx 



[0179] 



When quantification is carried out using the spread of a 
chromosome territory, for example, a method in which the form 
of the chromosome territory is approximated using the normal 
distribution may be used. The direction and the size of the 
spread of the chromosome territory may thereby be 
quantified. Specifically, with regard to an original image, a 
luminance value is considered to be the extent of the probability 
of a chromosome territory being present, and approximation is 
carried out by a mixed normal distribution. This processing may 
be carried out with the same procedure as that of the 
above-mentioned chromosome territory extraction method by the 
extraction processing unit 104. In this process, the 
coordinates of each pixel on an image are considered to be a 
2-dimensional probability vector, and a luminance value at that 
position is considered to be a probability value. In order to 
treat the luminance as a probability value, the sum of luminance 
values of all the pixels in the image is determined, and the 
luminance value of each pixel is divided by the sum so as to carry 
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out normalization. In this way, the form of the chromosome 

territory is quantified. 



[0180] 

The chromosome territory is present in the cell nucleus 
with a certain degree of spread, and it is thought that the form 
of this spread is related to ease of interaction between 
chromosomes or with the exterior through the nuclear 
membrane. Therefore, when quantifying the positioning state of 
the chromosome territory, it is expected that by taking into 
consideration the spread of the chromosome territory, the cell 
state can be evaluated with good accuracy, 

[0181] 

When quantification is carried out using the positioning 
direction between chromosome territories, a principal axis of 
each chromosome territory may be detected, and a result of 
quantifying an angle formed by these principal axes may be 
used. The principal axis of the chromosome territory may be 
calculated by, for example, a normal distribution as described 
above. In this way, by approximating the form of the chromosome 
territory using the normal distribution, the principal axis of 
the spread of each chromosome territory may be identified 
clearly. 

[0182] 

In this process, estimated parameters are as follows. 
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P (™lr Pi/ Si, w 2 , p 2 , S 2 ) = Wi x 3> (yi, Si) + W 2 x O (p2r S 2 ) 

Here, £ (p, S) denotes a two-dimensional normal distribution, 
p denotes an average value, and S denotes a covariance 
matrix. The parameter w obtained as a result of the above denotes 
the ratio of the size of the spread, p denotes the position of 
the center of the spread, and s denotes the principal axis of 
the spread. Furthermore, by decomposing the covariance matrix 
into eigenvalues, the principal axis of the spread is 
specifically obtained. By quantifying the form as described 
above, the positioning state of the chromosome territories can 
be expressed numerically. 

[0183] 

When the positioning state of two chromosome territories 
is considered, it is thought that in a case in which the principal 
axes of the spread of the two chromosome territories are parallel 
to each other, an area of interaction is larger and they have 
more influence on each other compared with a case in which they 
are perpendicular to each other. Therefore, when the 
positioning state of a chromosome territory is quantified, by 
taking into consideration the form of the spread or the 
positioning direction of the chromosome territory, it can be 
expected that a cell state may be evaluated with good accuracy. 

[0184] 

In a case in which the distance between a chromosome 
territory and a reference point within a cell is quantified, the 
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reference point within a cell may be on the nuclear membrane or 

at the center of gravity. Furthermore, the nuclear membrane 

referred to in this case may be the surface of a reference sphere 

calculated by the above-mentioned method* In general, it is 

known that, when a chromosome is present in an outer edge part 

of the cell nucleus, it is in a more genetically active state 

than when it is present in a central part. Therefore, it can 

be expected that, by quantifying the distance between the 

chromosome territory and the cell nucleus membrane or the 

distance between the chromosome territory and the cell nucleus 

membrane, the genetic activity of the cell may be evaluated. 

[0185] 

The quantification processing unit 106 may quantify a 
positioning state of the chromosome territory using the 
above-mentioned methods singly or in a combination of a plurality 
thereof. By use of the results of quantification by the 
plurality of methods, a cell state can be evaluated in further 
detail . 

[0186] 

(Evaluation (S26) ) 

Evaluation of a cell state may be carried out by various 
methods, but by subjecting the quantification results obtained 
for a plurality of samples to statistical processing and 
comparing the results of the statistical processing, the cell 
state of a particular sample may be evaluated, 
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[0187] 



Statistical processing may employ various methods; for 
example, the statistical processing unit 108 may calculate a 
standard value of the results of quantification of the 
positioning state of the chromosome territory of a plurality of 
samples. In this case, as the standard value, an average value 
of the results of quantification of the positioning state may 
be used. When a standard value is calculated in this way, by 
comparing a result of quantification of a positioning state of 
the chromosome territory of a particular sample with the standard 
value, the cell state of the particular sample may be 
evaluated. In this case, the evaluation device 100 may include, 
as shown in FIG. 13, the statistical processing unit 108 and a 
statistical result memory unit 116 in addition to the 
constitution shown in FIG. 2. The statistical processing unit 
108, for example, calculates the above-mentioned standard value 
and stores the standard value in the statistical result memory 
unit 116, The evaluating unit 110 may evaluate a cell state of 
a particular sample by comparing a quantification result of the 
particular sample with the standard value. 

[0188] 

Furthermore, the statistical processing may store a result 
of quantification of a positioning state of the chromosome 
territory of a sample and a corresponding actual diagnosis result 
of the provider of the sample. For example, quantification data 
of a positioning state of the chromosome territory of a cell 
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sampled from an individual with a disease such as cancer and 

quantification data of a positioning state of the chromosome 

territory of a cell sampled from an individual without such a 

disease may be prepared. The evaluating unit 110 may evaluate 

whether or not a tested individual has a disease by determining 

which of the quantification data is close to the quantification 

result of a positioning state of the chromosome territory of a 

cell sampled from the tested individual. 

[0189] 

in the present embodiment, a cell state is evaluated using 
the result of quantifying a positioning state of the chromosome 
territory, and the existence of a disease is determined based 
on the result. Since a change in the positioning state of a 
chromosome territory occurs in an earlier stage than the stage 
at which a cell undergoes morphological change, early 
identification of a disease may be expected. 

[0190] 

Furthermore, the statistical processing unit 108 may 
construct a neural network based on quantification results 
obtained from a plurality of samples. Here, for example, a 
plurality of results obtained by quantification by various 
methods, such as the distance between a plurality of chromosome 
territories, the spread of the chromosome territory, the 
positioning direction, or the distance between a chromosome 
territory and a reference point within a cell may be inputted 
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as input parameters. The evaluating unit 110 may evaluate a cell 

state by the output of the neural network. 
[0191] 

Moreover, the evaluating unit 110 may quantify, using the 
t-test or the chi-square test, a difference between the result 
of quantifying a positioning state of a single sample and the 
result of statistical processing, 

(Example) 

[0192] 

Using an adipocyte (25th cell and 13th cell), a 
three-dimensional color image (554 * 576) was obtained. The 
color image here was obtained by the 3D-F1SH method using probes 
that complementarily bonded to chromosome 16, chromosome 12, and 
the nucleus . 

[0193] 

Such a color image was inputted by the image acquiring unit 
102. The extraction processing unit 104 extracted chromosome 
territories and the nucleus from the image using the 
above-mentioned coarse-grained region extraction method with a 
coarse graining resolution of 8 and a number of classes of 3. The 
classes were assigned respectively to the chromosome territory 
of chromosome 12, the chromosome territory of chromosome 16, and 
the nucleus , 



93 



Ref,:34103785 Appln. No. JP2003-282122 Filing Date: July 29, 2003 

[0194] 



As a result, as shown in FIG , 14, the chromosome territory 
(class 1) of chromosome 12, the chromosome territory (class 2} 
of chromosome 16, and the cell nucleus (class 3) were 
extracted, FIG. 14 shows the extracted image. 

[0195] 

Subsequently, the distance between the center of gravity 
of the chromosome territory of chromosome 16 and that of the 
chromosome territory of chromosome 12 was calculated by the 
quantification processing unit 106. Chromosome 16 and 
chromosome 12 contain homologous chromosomes, and among these, 
the shortest distance between chromosome 16 and chromosome 12 
was employed- This is because it is surmised that interaction 
such as translocation occurs at a position where the distance 
between the chromosome territories is the shortest. 

[0196] 

A reference sphere of the cell nucleus extracted from the 
image data was first calculated, and the chromosome territory 
of chromosome 12 and the chromosome territory of chromosome 16 
were normalized- Here, since the chromosome territory had a 
substantially flat form, transformation in the z direction was 
not carried out, and two-dimensional transformation was carried 
out. When three-dimensional transformation is carried out, the 
same processing procedure may be carried out* 
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[0197] 



After transformation was carried out in this way, the 
distance between the center of gravity of chromosome 12 and that 
of chromosome 16 was calculated for each of the 25th cell and 
the 13th cell, it was found that the distance between the centers 
of gravity in the 25th cell was 3.38 pm, and the distance between 
the centers of gravity in the 13th cell was 4.12 \im, 

[0198] 

The present invention is explained by way of an embodiment 
and an example. The embodiment and example are illustrative only 
and it can be understood by a person skilled in the art that 
various modification examples are possible and such modification 
examples are included in the scope of the present invention. 

[A Brief Explanation of the Drawings] 

[0199] 

[FIG. 1] A flowchart showing a processing procedure of 
a cell state evaluation method in an embodiment of the present 
invention. 

[FIG. 2] A block diagram showing an evaluation device 
of the present embodiment carrying out the processing procedure 
shown in FIG. 1. 

[FIG. 3] A block diagram showing an extraction processing 
unit shown in FIG. 2. 
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[FIG. 4] A flowchart showing a processing procedure of 

the extraction processing unit. 

[FIG. 5] A diagram showing a coarse-grained data space 
and a partial space when coarse-graining has been carried out. 

[FIG. 6] A flowchart showing a processing procedure of 
initial value determination for a parameter based on a 
coarse-grained empirical distribution. 

[FIG. 7] A diagram specifically explaining the procedure 
explained with reference to FIG. 6. 

[FIG. 8] A block diagram showing another example of the 
extraction processing unit, 

[FIG. 9] A flowchart showing a processing procedure of 
the extraction processing unit shown in FIG. 8. 

[FIG. 10] A flowchart showing a processing procedure for 
quantifying a positioning state of a chromosome territory. 

[FIG. 11] A schematic diagram showing a manner in which 
coordinates of a chromosome territory are transformed. 

[FIG. 12] A diagram showing a plurality of chromosome 
territories whose coordinates have been transformed into the 
interior of a reference sphere. 

[FIG. 13] A block diagram showing another example of the 
evaluation device . 
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[FIG. 14] A diagram showing a chromosome territory 

extracted by the extraction processing unit of the present 

embodiment . 

[Description of Numerals] 
5 [0200] 

1 inputting device 

2 data space coarse-graining device 

3 coarse-grained empirical probability distribution 
calculating device 

10 4 coarse-grained conditional probability distribution 
calculating device 

5 class membership probability calculating device 

6 parameter updating device 

7 evaluation function calculating device 
15 8 region extraction device 

9 outputting device 

100 evaluation device 

102 image acquiring unit 

104 extraction processing unit 
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106 quantification processing unit 



108 statistical processing unit 



110 evaluating unit 



112 outputting unit 



5 120 cell nucleus 



122 chromosome territory 



124 reference sphere 



12 6 chromosome territory (after coordinate-transformed) 



126a chromosome territory {after coordinate-transformed) 



10 126b chromosome territory (after coordinate-transformed) 
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[Fig. 2] 
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[Fig. 4] 
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[Fig. 6] 
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[Document Name] Abstract 

[Abstract] 

[Problem] A method of evaluating a cell state based on 
information of an image taken of a cell containing a chromosome 

5 territory is provided. 

[Means for solving the Problem] This method includes extracting 
the chromosome territory from the image (S20), standardizing a 
positioning state of the chromosome territory and then 
quantifying the positioning state (S22) , and evaluating the cell 

0 state based on the quantified positioning state of the chromosome 
territory (S26) . 
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